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(57) Abstract: The invention relates to a method for the selec- 
tive imaging of body structures, in which method - a first image 
data set is acquired by means of a first tomography method, - a 
second image data set is acquired by means of a second tomog- 
raphy method which has a resolution which is higher than that 
of the first method, the image data of the first and the second 
image data set coinciding at least partly in space, - an image 
is reconstructed from the first image data set, and - the im- 
age data to be imaged is selected from the first image data set 
by means of the second image data set. In order to achieve a 
higher imaging quality while using a low -re solution tomogra- 
phy method, in accordance with the invention it is proposed 
that for the image reconstruction fix)m the first image data set 
- first at least one image region to be imaged is selected from 
the second image data set, and - subsequently the image recon- 
struction is calculated from the image data of the first image 
data set which are situated in the selected image region. 
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Organ-specific bacIq>rojection 



The invention relates to a method for the selective imaging of body structures, 
in which method 

- a first image data set is acquired by means of a first tomography method, 
" 2l second image data set is acquired by means of a second tomography 

5 method which has a resolution which is higher than that of the first method, the image data of 
the first and the second image data set coinciding at least partly in space, 

- an image is reconstructed fi-om the first image data set, and 

- the image data to be imaged is selected by means of the second image data 

set. 

10 The invention also relates to a device for the selective imaging of body 

structures in conformity with the described method and to a computer program which is to be 
executed on a computer and comprises programming means for executing the described steps 
of the method. 

Many tomography methods, notably tomography methods intended for nuclear 
15 medicine, such as SPECT (Single Photon Emission Computed Tomography) or PET 

(Positron Emission Tomography) methods, have the advantage that they provide the viewer 
of the tomographically formed image with information which goes beyond pure morphology 
and that in some cases they also visualize physiological processes. Such tomography methods 
have the drawback, however, that they have only a low spatial resolution so that often only a 
ZO very poor imaging quality is achieved, notably for fine structures. 

In order to avoid this drawback it is known to combine said tomography 
method with a fiirther tomography method. The second tomography method then images the 
same region as the previously described tomography method having the low resolution. On 
the basis of the second tomography method, having a higher resolution, the viewer can then 
25 select a given region of interest fi-om the overall image; very exact selection (so-called 
segmentation) is then possible because of the high resolution of the second method. 
Subsequently, that region of the low-resolution tomography image, produced by the first, 
low-resolution tomography method, which corresponds to the selected region of the high- 
resolution tomographic image is associated therewith by way of image registration, and 
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exclusively this region is imaged. A method of this kind is described in the article "Iterative 
Reconstruction of Emission Tomography Data with A Priori Information", Vollmar St. et al.. 
Transactions on Medical Imaging, 199. 

This type of combination of two tomography methods has the drawback that 
the original image acquired by means of the low-resolution tomography method is 
reconstructed in a conventional manner and that the selection of a detail of this image by 
means of the high-resolution method takes place only at a later stage. For the conventional 
reconstruction of the image, the acquired image data are backprojected regularly; during such 
backprojection the signals measured during the image acquisition by way of forward 
projection are distributed along the relevant projection line across the entire image region. 
Because of this distribution across the entire image region, the signals become unsharp and 
the distance-to-noise ratio becomes small. Experts in this field refer to this phenomenon as 
"smearing". 

Such smearing is particularly disadvantageous when an iterative method is 
used for the backprojection, because the smearing and the large image region to be measured 
necessitate a large number of iterations, thus prolonging the required calculation time and 
effort. 

Therefore, it is an object of the invention to provide a method which enables a 
higher imaging quality to be achieved for a low-resolution tomography method. It is also an 
object of the invention to provide a device and a computer program for carrying out said 
method. 

The object is achieved in accordance with the invention in that for the image 
reconstruction from the first image data set 

- first at least one image region to be unaged is selected firom the second image 

data set, and 

- subsequently the image reconstruction is calculated fi-om the image data of 
the first image data set which are situated in the selected image region. 

Therefore, the method in accordance with the invention does not calculate a 
backprojection across the entire image region during the image reconstruction. Instead, an 
image region which is of interest to the viewer is selected in advance. This selection is 
performed on the basis of image data which have been acquired by means of a second 
tomography method having a resolution which is higher than that of the first tomography 
method. It is notably possible to select regions of the image which contain the object to be 
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imaged or parts thereof. Furthermore, it is also possible to select a number of regions which 
may also be coherent, for example, vascular systems. 

The backprojection of the image data across the selected image region ensures 
that the image values are not smeared across the entire image region, but only across a 
5 smaller image region, that is, the selected image region. It is thus achieved that the signal-to- 
noise ratio (SNR) is increased and the quality of the images of the structures to be imaged is 
enhanced. 

The method in accordance with the invention is advantageous notably when 
the first tomography method is a nuclear-medical tomography method, notably a SPECT 

.0 method or a PET method. According to such methods, a contrast mediimi is administered to 
the patient prior to the tomographic acquisition of the image data. This contrast medium 
concentrates in given structures of the body, possibly in dependence on given physiological 
processes, and is imaged with a high contrast by the nuclear medical tomography method> 
SPECT and PET then have only a low spatial resolution of fi-om approximately 5 to 15 mm. 

• 5 In order to enhance the image quality, use can notably be made of a magnetic resonance 
tomography method or an X-ray tomography method (MR and CT, respectively). These 
tomography methods have a resolution in the range of from 0.5 to 1 mm. The use of the 
method in accordance with the invention is advantageous in particular when a combined 
CT/PET system or another tomography apparatus combining other tomographic methods is 

10 used for the tomographic imaging. 

According to an advantageous version of the method the selection of the 
image region is performed by means of an automatic segmentation method. 

In addition to the manual segmentation by the viewer, for example, by 
defining image boundaries or by selecting image comer points, notably automatic selection 

15 methods are advantageously used. According to the automatic selection methods, for 

example, a selection of the image elements to be imaged can be carried out on the basis of 
their image values (for example, grey values). For example, it is possible to select given body 
tissues on the basis of the image values of a computed tomography X-ray image (so-called 
HU values), said body tissues then being imaged or excluded from imaging. Furthermore, it 

30 is feasible for an automatic segmentation method to select regions which have the same or a 
similar image value and are coherent. Conventional segmentation methods, for example, the 
so-called regional growing method, can then be used. It may also be arranged that other 
methods, such as morphological opening or the like, are used for the automatic selection of 
an image region. 



wo 03/083778 PCT/IB03/01 122 

4 

The method in accordance with the invention may ensure in particular that the 
necessary association of the image data of the first and the second image data set with one 
another, that is, the so-called registration, is simplified or accelerated by associating 
exclusively image data of the first image data set which are to be imaged with the second 
S image data set. 

It is particularly advantageous to use the method in accordance with the 
invention when the image reconstruction is carried out by way of iterative backprojection. An 
iterative calculation then takes place in principle in such a manner that the difference is 
formed between intermediate results of an image calculation which is periodically performed 

0 in the same manner is formed and that the quality of the calculated image is evaluated on the 
basis of the value of the difference between two successive calculation cycles. Normally 
speaking, a limit value (convergence criterion) to be reached is then defined. 

Because the distance between the signal and the noise value is increased from 
the very start of the method in accordance with the invention, the method in accordance with 

5 the invention enables a reduction of the number of iteration steps required until a 

convergence criterion is met, that is, in comparison with the conventional method with 
smearing across the entire image region. Analogously, when the number of iteration steps in 
the method in accordance with the invention is kept the same as in conventional methods, the 
image quality of the image fomied by means of the method in accordance with the invention 

0 can be enhanced in comparison with the image quality of the image reconstructed in a 
conventional manner. 

A further aspect of the invention concerns a device for the selective imaging of 
body structures, which device includes first tomographic image data acquisition means, 
second tomographic image data acquisition means, having a resolution which is higjier than 

5 that of the first tomographic image data acquisition means, means for image reconstruction 
by baclq)rojection of an image, notably Grom a first image data set which has been acquired 
by means of the first tomographic image data acquisition means, and selection means for 
selecting at least one region of the image data to be imaged, preferably by selection of one or 
more regions of an image which has been derived fi-om the second image data set. The 

0 backprojection means co-operate with the selection means in such a manner that during the 
backprojection of the image data exclusively the image data are projected which are situated 
in the selected image region which was selected, by way of the second image data set, by the 
selection means. 
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Finally, a last aspect of the invention concerns a computer program with 
programming means for making a computer carry out the method of claim 1 when the 
computer program is executed on a computer. 

5 

A preferred embodiment of the invention will be described in detail hereinafter 
with reference to the Figures. Therein: 

Fig. 1 shows a flow chart of a method in accordance with the invention, 
Fig. 2 is a diagrammatic representation of the co-operation of the means of a 
10 device in accordance with the invention, and 

Fig. 3 shows a flow chart of a method for iterative backprojection. 



As is shown in Fig. 1, in conformity with the preferred version of the method 

15 in accordance with the invention first a computed tomography image SI of a body region is 
fomied; for this purpose several slice images of this body region are acquired at a given 
distance from one another. This computed tomography image yields a CT image data set Rl. 
Before or after the computed tomography image acquisition, a contrast medium is 
administered to the patient and a SPECT image S2 is formed, resulting in a SPECT image 

10 data set R2. The SPECT image S2 is preferably formed for the same body region and while 
using the same distance between the slice planes as for the CT image SI . 

For the CT image data set Rl and the SPECT image data set R2 there is 
performed an image superposition or registration operation S3 in which the image data of the 
CT image data set Rl which are situated in the same geometrical position as the image data 

15 of the SPECT image data set R2 are associated with one another. Known methods, for 

example, fiducial markers can be used for such association. The CT image SI and the SPECT 
image S2 need not necessarily cover an identical image region, but it suffices when the two 
images overlap in the region to be imaged. Furthermore, it is not necessary either for the 
spacing of the slices of the two images to be the same; it is also feasible that the distance 

}0 between the slices of one image amounts to an integer multiple of the distance between the 
slices of the other image. 

An image S4 is then reconstructed from the CT image data set Rl; customary 
methods, such as iterative or analytic backprojection, can be used for this purpose. In the CT 
image R3 thus formed a segmentation of the region S5 to be imaged is performed. This 
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segmentation can take place in a direction orthogonal as well as in a direction parallel to the 
projection direction, notably simultaneously in both directions. For example, a region to be 
imaged can be defined by setting a plurality of comer points of a region to be imaged or by 
drawing a boundary line around a region. It is also possible to select a plurality of regions to 
5 be imaged which are connected to one another or not. Furthermore, it is feasible for the 

segmentation to be executed automatically by the selection of image elements having a given 
range of image values or by the selection of coherent regions having a similar range of image 
values, for example, by way of the so-called region growing method. Furthermore, it is 
feasible to select stmctures in the image which are smaller or larger than a given value; 

10 customary methods, such as the morphological opening method, can be used for this purpose. 
It is also feasible to remove one or more image regions from the region to be imaged by 
means of a filtering operation. 

The segmented CT image R4 thus formed is converted into a segmented CT 
image data set R5 by way of a numerical forward projection S6. During this step, the selected 

15 image elements, that is, the segmented region to be imaged, can be associated again with the 
image data of the original CT image data set in a simplified manner. 

The image data of the segmented CT image data set are associated with the 
image data of the SPECT image data set in a next step S7, resulting in a segmented SPECT 
image data set R6. This segmented SPECT image data set R6 contams only the image data 

10 which are of relevance for the region to be imaged as selected on the basis of the CT image 
data set. In a fiirther step S8 an image is reconstructed from the segmented SPECT image 
data set, that is, preferably by iterative backprojection of the segmented SPECT image data 
set. During this iterative backprojection, the image data is smeared only across the region to 
be imaged, so regularly across a region which is substantially smaller than the overall image 

15 region, thus enhancing the signal-to-noise ratio. The image R7 thus reconstructed has sharper 
edges and contains more contrast. This reduces the number of iteration steps required for an 
image whose quality is substantially equivalent to that of an image obtained by means of a 
conventional reconstruction technique, meaning that the required calculation time and effort 
are less. Analogously, when the number of iteration steps is the same as that of the 

)0 conventional method, that is, while spending the same calculation time and calculation effort, 
an image of significantly higher quality can be formed. 

Fig. 2 is a diagrammatic representation of the construction of the device in 
accordance with the invention and of the programming means of the computer program in 
accordance with the invention. 




wo 03/083778 PCT/IB03/01122 

7 

The device comprises CT image acquisition means Ml and SPECT image 
acquisition means M2 which co-operate with image superposition or registration means M4. 
The CT image acquisition means Ml co-operate with image reconstruction means M3 for the 
CT image, which means form a CT image from the CT image data set. This CT image is 
5 segmented by means of manual segmentation means MS which are controlled by a user of the 
device, thus selecting a region to be image. 

The manual segmentation means co-operate with means for the numerical 
forward projection M7 of the selected CT image elements which form an image data set from 
the segmented image. 

0 Alternatively, as is denoted by the dashed lines in Fig. 2, the CT image 

acquisition means can co-operate with automatic segmentation means M6 which 
automatically select given data on the basis of preset parameters or parameters which can be 
influenced by the user of the device. 

The image data selected by means of the automatic segmentation means M6 or 

5 the image data produced by means of the numerical forward projection means, co-operate 
with image reconstruction means M8 for the SPECT image data. The image reconstruction 
means for the SPECT image data co-operate with the image superposition/registration means 
so as to associate the selected CT image data with the corresponding, geometrically 
identically situated SPECT image data. 

:0 Alternatively it may also be arranged to perform the image superposition or 

registration by means of the image superposition means M4 only at an instant after a manual 
(M5) or automatic (M6) segmentation, and hence also selection of the image elements to be 
imaged, has taken place. In that case there is no superposition of image regions or registration 
of image data which are not situated in a region to be imaged. 

:5 The image reconstruction means SPECT M8 form a high-quality nuclear 

medical image of the segmented image region from the selected image data. 

The reconstruction of an image from the segmented SPECT image data set S8 
by way of iterative backprojection will be described with reference to Fig. 3. The iteration 
consists in that first, in a backprojection SIO, an iteration image Rl 1 is calculated by 

•0 backprojection of the image data to be imaged of the first image data set R6, selected on the 
basis of the second image data set or the image Rl, R3, after which an iteration image data 
set R12 is numerically formed from this iteration image Rll in a calculation step SI 1. This 
iteration image data set R12 thus represents the result of a numerical forward projection S 1 1 
of the calculated image. Subsequently, a difference is formed between the numerically 
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fonned iteration image data set R12 and the first image data set RIO. This difference is a 
measure of the deviation between the iteration image data set R12 and the iteration start 
image data set RIO, If this difference is particularly small, the calculated image does not 
constitute a significant qualitative improvement relative to the initially calculated image. In 
this case the iterative calculation process is terminated and the calculated image Rll, R7 is 
output via an output S20. 

When the difference does not drop below a predetermined value (the 
convergence criterion), however, the difference is added to the iteration image data set SI 1 
and a new iteration start image data set R14 is calculated. Using this calculated iteration start 
image data set R14, representing the new iteration start mage data set RIO, subsequently an 
iteration operation is started again, at the end of which the difference is again used for 
evaluating the convergence and, should the converge criterion not be satisfied, the difference 
is again added to the iteration image data set R12 so as to form an iteration start image data 
set R14. 

The above iteration steps are repeated xmtil the convergence criterion is 
satisfied and the image Rl 1 last calculated is output to the viewer as a segmented SPECT 
image R7. 



wo 03/083778 PCT/IB03/01 122 



CLAIMS: 



1 . A method for the selective imagmg of body structures, in which method 

- a first image data set is acquired by means of a first tomography method, 

- a second image data set is acquired by means of a second tomography 
method which has a resolution which is higher than that of the first method, the image data of 

S the first and the second image data set coinciding at least partly in space, 

- an image is reconstructed firom the first image data set, and 

- the image data to be imaged is selected fix>m the first image data set by 
means of the second image data set, 

characterized in that for the reconstmction firom the first image data set 
0 - first at least one image region to be imaged is selected from the second image 

data set, and 

- subsequently the image reconstruction is calculated from the image data of 
the first image data set which are situated in the selected image region. 

5 2. A method as claimed in claim 1 , characterized in that the first tomography 

method is a nuclear medical tomogr^^hy method, notably SPECT or PET. 

3. A method as claimed in claim 1 , characterized in that the selection of the 
image region is performed by means of an automatic segmentation method. 

0 

4. A method as claimed in claim 1 , characterized in that the image reconstruction 
is carried out by way of iterative backprojection. 

5. A method as claimed in claim 4, characterized in that the calculation of the 

5 image consists of the initial calculation of an image by backprojection of the image data to be 
imaged of the first image data set, the following steps 

- numerical formation of an iteration image data set from the calculated image, 

- determination of the difference between the first image data set and the 
iteration image data set. 
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- calculation of an iteration image by addition of the difference to the 
calculated image, and the iterative repetition of these steps for the calculated iteration images 
until at least one convergence criterion is satisfied, that is, notably the difference dropping 
below a predetermined convergence value. 

6. A device for the selective imaging of body structures, which device includes 

- first tomographic image data acquisition means for the acquisition of a first 
image data set, 

- second tomographic image data acquisition means for the acquisition of a 
second image data set, which second tomographic image data acquisition means have a 
resolution which is higher than that of the first tomographic image data acquisition means, 

- backprojection means for image reconstmction of an image fi-om the first 
image data set, and 

- selection means for selecting, by means of the second image data set, the 
image data to be imaged, characterized in that the backprojection means co-operate with the 
selection means in such a manner that the image is calculated exclusively firom the image 
data of the first image data set which are situated in the selected image region. 

7. A computer program which includes programming means for making a 
computer carry out the method claimed in claim 1 when the computer program is executed on 
a computer. 



wo 03/083778 



PCT/ra03/01122 



1/3 



SI- 
R1 




CT image 



CT 

image data set 



SPECT image 




R2 




SPECT 
image data set 




image superposition/registration 



S4 



reconstruction of an image from the 
CT image data set 



CT image^^^^ 




segmentation of the 

region to be imaged 



segmented CT image region 



S3 



nummerical forward projection of the 
segmented CT image region 




association of the 
segmented CT image data set 
with the image data set 



s 7 



R6 




segmented 
SPECT image data set 




S8 



reconstruction of an image from the 
segmented SPECT image data set 



R7 



I 




segmented 
SPECT image 




FIG.1 



wo 03/083778 



PCT/IB03/01122 



2/3 



M 1 



CT 

image acquisition means 



M 3 



image reconstruction means 
CT 



M 5 



X ' 

manual 
segmentation means 



M2 



M4 



SPECT 
image acquisition means 



I 



image superposition/ 
registration means 



M6 



automatic 
segmentation means 



7 

M7 



nummericai fonvard projection 
means CT 

^ 



M 8 



image reconstruction means 
SPECT 



FIG.2 



wo 03/083778 



PCT/m03/01122 



3/3 



RIO 



iteration start image data set 




image data to be visualized ^ 
of 1®* image data seti^^ 

R6 



calculation of an 
image by backprojection 




Iteratlonstart image data set 



calculation of an 
iteration image data set 




S11 



R12 



calculation of the 
difference 



S13 






adddition of the difference 
to iteration image data set 




S 14 


^812 









yes 



output of the 
iteration image 



S 20 




INTEBNATIONAL SEARCH REPORT 



PCT/IB 03/01122 



A. CLASSIFICATION OF SUBJECT MATTER , 

IPC 7 G06T11/00 A61B5/055 A61B6/03 



According lo International Patent Classificalion (PC) or lo both fiationai ciass^ficalion and IPC 



B. RELDS SEARCHED 



Minimum documentation searched (dassification system foltowed by classification symbols) 

IPC 7 606T A61B 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Etectronlc data base consulted during the international search (name of data base and, where practical, search terms used) 

EPO-Internal , INSPEC 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category " Cliailon of document, with IndicatlGa where appropriate, of the relevant passages 



Relevant to dalm No. 



LIPINSKI ET AL.: "Expectation 
Maximization Reconstruction of Positron 
Emission Tomographic Images Using 
Anatomical Magnetic Resonance Information" 
IEEE TRANSACTIONS ON MEDICAL IMAGING, 
vol. 16, no. 2, 1 April 1997 (1997-04-01), 
pages 129-136, XP002244909 
page 129, left-hand column, paragraph 1 
-page 130, left-hand column, paragraph 3 
page 134, right-hand column, paragraph 2 
-page 136, left-hand column, paragraph 1 
abstract 



1-7 



Further documents are listed In the continuation of box C. 



□ 



Patent famly members are listed In annex. 



« Spedal categories of cited documents : 

*A' document defining the general state of the art which is not 

considered to be of particular relevance 
*E' earlier document but pubiished on or alter the international 

filing date 

*L* document which may throw doubts on fMiorlty daim(s) or 
which is cited lo establish the publication dale of another 
cilation or other spedal reason (as speciied) 

•O* document referring to an oral disclosure, use, exhibition or 
other means 

*P' docunnent published prior to the international filing date but 
later than the priority date claimed 



*T' later document published after the Intemational filing dale 
or priority date and not in conflict with the application but 
cited to understand the principle or theory undertying the 
invention 

"X" docun^nt of particular relevance; the claimed inventton 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

'Y* document ol particular retevanoe; ttte claimed invention 

cannot tie considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such combination toeing obvious to a person sMIled 
in (he art. 

'&' document member of the same patent family 



Date ol the actual completion of the international search 



19 June 2003 



Date ol mailing of the intemational search report 



02/07/2003 



Name and mailing address of the tSA 

European Patent Olfice. P.B. 5818 Patentlaan 2 
NL- 22dOHV Rriswijk 
Tel. (4-31-70) 340-2040, Tx. 31 651 epo nl. 
Fax: (+31-70) 340-3016 



Authorized officer 



Manschot, J 



Form PCr/lSA/210 (second eheet) (July 1992) 



page 1 of 2 



INTEaNATIONAL SEARCH REPORT 



C.(Contlnuatlon) DOCUMENTS CONSIDERED TO BE RELEVANT 


Categofy * 


Cflation of dooimenl. wUh Indlcatfon.where approprlaie. of the relavani passages 


Relevant to claim No. 


X y 


YONG ZHANG ET AL: "Incorporating MRI 
region Information into SPECT 
reconstruction using Joint estimation" 
ACOUSTICS. SPEECH, AND SIGNAL PROCESSING, 
1995. ICASSP-95.. 1995 INTERNATIONAL 
CONFERENCE ON DETROIT, MI. USA 9-12 MAY 
1995, NEW YORK, NY, USA, IEEE, US, 
9 May 1995 (1995-05-09), pages 2307-2310, 
XP010151802 
ISBN: 0-7803-2431-5 

page 2307, left-hand column, paragraph 1 
-page 2308, right-hand column, paragraph 
2.2 

abstract 


1-7 




VOLLMAR ST ET AL: "Iterative 
reconstruction of emission tomography data 
with a-prlori -information" 
NUCLEAR SCIENCE SYMPOSIUM, 1998. 
CONFERENCE RECORD. 1998 IEEE TORONTO, 
ONT.. CANADA 8-14 NOV. 1998, PISCATAWAY, 
NJ, USA, IEEE, US, 

8 November 1998 (1998-11-08), pages 
1560-1561, XP010338179 
ISBN: 0-7803-5021-9 
cited in the application 
the whole document 


1.2,4.6, 
7 



Form PCT/ISA/210 (cantinueelkm of seoond sheet) (July 1098) 



page 2 of 2 



